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ABSTRACT 

Researchers have frequently found that leadership plays a key role in the successful and effective implementation of 
technology in K-12 school districts (Meltzer & Sherman, 1997; Schiller, 2002; Bliss & Bliss, 2003; Anderson & Dexter, 2005]. A 
key component of the Michigan Freedom To Learn (FTL.]: One-to-One Learning initiative evaluation was to obtain valid 
data from a rigorous and comprehensive research study to gauge the impacts of the program relative to its primary 
goals. An evaluative research component examining the effectiveness of leadership in FTL initiative as perceived by FTL 
teachers and lead teachers was added as an extension to the initial multi-year evaluation plan to examine the roles of 
school leadership (principals, assistant principals, or others] in relationship to the effective implementation of fhe FTL 
laptop program. 

This paper summarizes the 2007-2008 evaluation results of the leadership survey distributed to Michigan Freedom to 
Learn [FTL] program teachers, in their effort to improve student learning and achievement in Michigan schools through 
the integration of laptop computers with teaching and learning in K-12 classrooms. The results obtained from the survey 
provided insight into the relationships between the identified leadership attributes and successful program 
implementation. 

Keywords: K-12 Instructional Technology Implementation, Student Laptops, Educational Leadership, Administrative 
Roles, Levels of Support. 


INTRODUCTION 

The research study presented in this paper summarizes the 
2007-2008 evaluation results of a leadership survey 
distributed to teachers participating in the Michigan 
Freedom to Learn (FTL) program. The major goal of the FTL 
program was to improve student learning and 
achievement in Michigan schools through the integration 
of 21 st Century technology tools with teaching and 
learning in K-12 classrooms. A key component of the FTL 
program was a consistent, rigorous, and comprehensive 
evaluation study designed to gauge the impacts of the 
program relative to its primary goals. By providing annual 
formative evaluations of the program, progress towards 
the achievement of the program goals could be 
monitored and interventions could be implemented so as 
to adjust the program accordingly. The final evaluative 


component, the Leadership survey, was not used until the 
end of the five-year annual evaluation period, and thus 
provides a summative evaluation of the role of leadership 
in the implementation of the FTL program. 

Background 

The primary goal of the Freedom to Learn (FTL) Program as 
implemented from 2004-2008 was to improve student 
learning and achievement in Michigan schools through 
the integration of 21 st Century technology tools consisting 
of laptop computers and software-with teaching and 
learning in K-12 classrooms. The program was developed 
with the intention of building outward from a 2002-03 pilot 
program involving fifteen middle schools, "Learning 
Without Limits". The primary mission of the FTL program was 
to provide to teachers, administrators, and program 
professionals with the appropriate professional 
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development. Developing innovative instructional 
support tools and facilitating access to high quality digital 
resources were also key targeted goals of the program. 

A central component of the FTL initiative was to 
continuously obtain valid data from a rigorous and 
comprehensive evaluation study to gauge the impacts of 
the program relative to its primary goals. The Center for 
Research in Educational Policy (CREP) at The University of 
Memphis proposed an evaluative research component 
as an extension to the multi-year comprehensive 
evaluation plan. Specifically, the extended evaluation 
examined the effectiveness of leadership in Michigan's 
Freedom to Learn (FTL): One-to-One Teaching and 
Learning Initiative as perceived by FTL teachers and those 
identified as Lead Teachers. 

Purpose of the Study 

Researchers have frequently found that leadership plays 
a key role in the successful and effective implementation 
of technology in K-l 2 school districts (Meltzer & Sherman, 
1997: Schiller, 2002; Bliss & Bliss, 2003; Anderson & Dexter, 
2005). A key component of the Michigan Freedom To 
Learn (FTL): One-to-One Learning initiative evaluation was 
to obtain valid data from a rigorous and comprehensive 
research study to gauge the impacts of the program 
relative to its primary goals. An evaluative research 
component examining the effectiveness of leadership in 
FTL initiative as perceived by FTL teachers and lead 
teachers was added as an extension to the initial multi¬ 
year evaluation plan to examine the roles of school 
leadership (principals, assistant principals, or others) in 
relation to the effective implementation of the FTL laptop 
program. 

The overall purpose of the summative evaluation was thus 
to examine the roles of school leadership in relation to 
effective implementation of the FTL laptop program. 
Evidence of these roles was determined by surveying FTL 
classroom teachers and Lead Teachers and comparing 
the results by level of FTL implementation at each school 
as measured by classroom observation data obtained 
previously during the initial formative evaluations. 


The evaluation had three main goals: 

• to determine which school administrators (principals, 
assistant principals, or others) were perceived to have 
fulfilled the primary leadership role effecting 
implementation of the FTL program; 

• to identify specific roles of school administrators 
and to what degree that FTL Classroom Teachers and 
Lead Teachers perceived how the roles affected the 
FTL program implementation; and 

• to determine if implementation level varied on the 
basis of leadership roles. Therefore, the research 
question encompassing the above was: 

What is the relationship between the successful 
implementation of the FTL program and the perception of 
the teacher participants towards school leaders; and 
what are the leadership traits identified as the most 
conducive to the successful implementation of the FTL 
program, as perceived by the teacher participants? 
Methodology 

A global descriptive design was used for the evaluation. 
This design employed a mixed-methods approach 
(Johnson & Onwuegbuzie, 2004) utilizing validated data 
collection instruments. Validated survey and observation 
instruments, and student performance-based 
assessments served os the critical data sources in the 
comprehensive evaluation model. Data collection 
procedures for the two primary data sources used for this 
study were the Leadership Effectiveness Assessment 
Device (LEAD”) survey plus FTL School Observation 
Measure (SOM®) and the Survey of Computer Use (SOU®) 
data previously collected during multi-class observations. 
Instrumentation and Procedures 
Two primary data sources were used for this study: 
i) FTL teacher and Lead Teacher responses to the 
Leadership Effectiveness Assessment Device [LEAD] survey 
(Appendix) and 

li) extant observation data from the School Observation 
Measure (SOM) and the Survey of Computer Use (SOU) to 
determine level of FTL implementation at each school. A 
description of the instruments and data collection 
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procedures follows. 

Leadership Effectiveness Assessment Device (LEAD) 
Survey 

High levels of interest in the impact of principals on school 
performance have resulted in several national and 
regionally-based statements of professional standards 
and issued in a growing number of reviews of the 
empirical literature. Taking both sorts of documents into 
account, the Leadership Effectiveness Assessment Device 
(LEAD) expresses their contents as observable behaviors 
and maps such behaviors onto a comprehensive model 
of organizational and leadership effectiveness called the 
Competing Values Framework (CVF). Within the LEAD, the 
CVF is evoked as an "organizing mechanism, a sense¬ 
making device, a source of new ideas, and a learning 
system" (Cameron, Quinn, DeGraff, &Thakor, 2006, p. 6) to 
help articulate "best practices" in educational leadership 
in way that is more cognitively tractable and growth¬ 
enabling. 

Development of the Competing Values Framework as a 
Map of Effectiveness 

Subjecting a list of effectiveness criteria to the judgments 
of a panel of organizational theorists, researchers Robert 
Quinn and John Rohrbaugh (1983) found that most of the 
similarities and dissimilarities among these judgments 
could be explained in terms of a perceptual map defined 
by two major dimensions specifically, internal versus 
external focus and centralized control versus 
decentralized flexibility and forming four "quadrants." As 
shown in Figurel, these four effectiveness quadrants 
include the following: 

• The rational goal model: The emphasis of which is on 
attending to the "bottom line" and articulating a clear 
course of action to achieve it: 

• The internal process model, wherein the emphasis is 
on maintaining a smooth-running, efficient 
organization that persists over the long-term; 

• The human relations model, the emphasis of which is 
on building teamwork and cultivating employees' 
skills and competencies; and 

• The open systems model wherein the emphasis is on 


Human Relations Model 

Open Systems Model 

Process : cohesion, morale 

Process : flexibility, readiness 

Outcome: human resource development 

Outcome: growth, resources acquisition 

MENTOR ROLE 

INNOVATOR ROLE 

FACILITATOR ROLE 

BROKER ROLE 

MONITOR ROLE 

PRODUCER ROLE 

COORDINATOR ROLE 

DIRECTOR ROLE 

Process : information management, 
communication 

Process: Planning, goal-setting 

Outcome: stability, control 

Outcome: productivity, efficiency 

Internal Process Model 

Rational Goal Model 


Figure 1. Competing Values Framework: Organizational 
effectiveness and leadership roles 


innovation and the acquisition of "slack" resources to 
support the organization's growth. 

Because even- and odd-numbered quadrants were 
observed to highlight conflicting but critical 
organizational concerns, the map as a whole was named 
the Competing Values Framework. 

Application of the Competing Values Framework to 
Leadership Effectiveness 

Later refinement and application of the CVF to the 
phenomenon of leadership (For example, Cameron, 
Quinn, DeGraff, & Thakor, 2006; Quinn, 1984; Quinn 1988; 
Quinn, Faerman, Thompson, McGrath, & St. Clair, 2007) 
suggested the presence of two distinct clusters of 
activities or "roles" within each of the four effectiveness 
quadrants: one "role" speaking directly to a particular 
model's desired outcomes, the other "role" addressing 
prerequisite processes aimed at those outcomes. 
Signature activities linked to each of these eight CVF 
"roles" are as follows: 

• The innovator role : concerns searching for innovation 
and improvements, solving problems in creative 
ways, and envisioning needed changes. 

• The broker role : concerns exerting upward influence, 
acquiring needed resources, and spanning 
boundaries between the organization and its 
environment. 

• The producer role : concerns getting the work done, 
focusing on customer needs, and sustaining an 
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achievement orientation, 

• The director role : concerns designing a course of 
action, clarifying priorities; and communicating the 
organizations goals. 

• The coordinator role : involves bringing a sense of 
order into the workplace and ensuring that 
organizational processes run smoothly and efficiently. 

• The monitor role: involves collect information, 
ascertaining progress, and holding regular reviews of 
various kinds, 

• The facilitator role: involves teambuilding 
engendering cohesion and consensus, and 
managing interpersonal conflicts. 

• The mentor role: involves individual capacity building, 
listening empathically to others' concerns, and 
treating each staff member in a caring way. 

In the vernacular of the Competing Values Framework, the 
multi-step process that Quinn and his associates (2007) 
label "becoming a master manager" entails i) recognizing 
that there are, in fact, multiple roles to be played (referred 
to as "cognitive complexity"); ii) acquiring the requisite 
skills associated with the roles (called "behavioral 
complexity"); and iii) enacting appropriate roles 
contingent upon the situation (known as "behavioral 
differentiation") and in a value-maximizing way (alluded 
to variously as "interpenetration," "synergy," and "ever- 
increasing integrity"). 

Application of the Competing Values Framework to 
Educational Settings 

Largely developed with for-profit organizations in mind, 
the CVF has been more often and more completely 
applied in college and university settings. Within K-12 
contexts, the framework has recently inspired empirical 
studies of school effectiveness (Barath, 1999; Griffin, 
2003); but, at present, accounts of how the CVF might be 
applied to the phenomenon of principal effectiveness 
have been suggestive only (Davies & Coates, 2005). 
Perhaps the most pertinent example concerns a 
nationwide study conducted in the United Kingdom and 
entitled Leading Schools in Times of Change (Day, Plarris, & 
Hadfield, 1999; Day, Harris, Hadfield, Tolley, Beresford, 


2000). Therein, researchers associated with the National 
College of School Leadership (NCSL) explicitly noted how 
their findings concerning highly effective school 
"headship" seemed to mirror the structure and dynamics 
of the Competing Values Framework, which fact 
prompted them to offer that "it is worth examining further 
the'competing values theoretical framework'.. .for much 
may be applied to current and future educational 
contexts" (p. 168). However, in these same researchers' 
more recent review of the literature on Successful School 
Leadership: What It Is and How It Influences Pupil Learning 
(Leithwood, Day, Sammons, Harris, & Hopkins, 2006), the 
CVF is at best employed as an organizing device, albeit 
with different labels applied to its four quadrants: namely, 
"building vision and setting directions" substituted for the 
CVF's rational goal model ; "understanding and 
developing people" replacing the CVF's human relations 
model: "redesigning the organization" taking the place of 
the CVF's open systems model: and "managing the 
teaching and learning program" serving as the proxy for 
the CVF's internal process model. Table 1 provides the 
parallels between the 2006 and 2000 NCSL statements. 
Item Development and Content Validation of the LEAD 
Instrument 

Given the perceived usefulness of the CVF in studying 
school leadership but the absence of an appropriate 
instrument, recent statements of educational leadership 
standards (Bottoms & O' Neill, 2001; Council of Chief 
School Officers, 1996; National Association of Secondary 
School Principals, 2004) as well as present and past 
reviews of research (Cotton, 2003, Hallinger & Heck, 1997; 
Leithwood, Day, Sammons, Hopkins, & Harris, 2006; 
Leithwood, Louis, Anderson, & Walstrom, 2004; Marzano, 
Waters, & McNulty, 2005) were consulted to determine 
specific behaviors that aligned with the four quadrants of 
the CVF and the leadership roles within them. From these 
documents, a pool of items was developed by doctoral 
students and faculty members within the Department of 
Instruction and Curriculum Leadership, College of 
Education, University of Memphis. To secure content 
validity, these items were subsequently reviewed by a 
panel of school principals and professors of educational 
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Leithwood et al., 2006 


Day et al., 2000 


Building vision and setting directions. 

This category of practices carries the 
bulk of the effort to motivate leaders' 
colleagues. It is about the 
establishment of shared purpose as a 
basic stimulant for one's work. The 
more specific practices in this 
category are building a shared vision, 
fostering the acceptance of group 
goals and demonstrating high- 
performance expectations. 


Understanding and developing 
people. While practices in this 
category make a significant 
contribution to motivation, their 
primary aim is building not only the 
knowledge and skills that teachers 
and other staff need in order to 
accomplish organizational goals but 
also the dispositions (commitment, 
capacity and resilience) to persist in 
applying the knowledge and skills. The 
more specific practices in this 
category are providing individualized 
support and consideration, fostering 
intellectual stimulation, and modeling 
appropriate values and behaviors. 


Rational goal model. In this quadrant, 
the primary emphasis is on the pursuit 
and attainment of well-defined 
objectives; Herein, norms and values 
are associated with productivity, 
performance, goal fulfillment, and 
achievement. Motivations are 
competition and successful 
achievement of predetermined ends. 
Cultural dimensions which reflect this 
model are: vision - a concern with 
clearly defining where the organization 
is heading; emphasis on quality: 
pressure to produce - where 
employees feel pressured to meet 
targets and deadlines; and 
performance feedback - where clear 
feedback is available about job 
performance. 


Human relations model. In this CVF 
quadrant, the primary emphasis is on 
norms and values associated primary 
emphasis is on norms and values 
associated factors are attachment, 
cohesiveness and group membership. 
Cultural dimensions linked to this are: 
concern for employee welfare - the 
extent to which employees feel 
valued and trusted; autonomy - 
designing jobs in ways which give 
employees wide scope to enact work; 
emphasis on training -a concern with 
developing employee skills; and 
supervisory support. 


Redesigning the organization. The 

specific practices included in this 
category are concerned with 
establishing work conditions which, for 
example, allow teachers to make the 
most of their motivations, 
commitments and capacities. School 
leadership practices explain 
significant variations in teachers' 
beliefs about and responses to their 
working conditions. Specific practices 
are building collaborative cultures, 
restructuring and re-culturing the 
organization, building productive 
relations with parents and the 
community, and connecting the 
school to its wider environment. 


Open systems model. In this CVF 
quadrant, the primary emphasis is on 
change and innovation. Herein, norms 
and values are associated with 
growth, resource acquisition and 
adaptationMotivational factors are 
growth, variety, and stimulation. 
Cultural dimensions which reflect this 
orientation are: Outward forms- Where 
the organization is attuned to the 
external environment; flexibility; 
innovation and reviewing objectives-a 
concern with reviewing and reflecting 
upon progress in order to improve. 


Managing the teaching and learning Internal process model. In this CVF 


program. As with redesigning the 
organization, the specific practices 
included in this category aim to 
create productive working conditions 
for teachers, in this case by fostering 
organizational stability and 
strengthening the school's 
infrastructure. Specific practices are 
staffing the teaching program. 


quadrant, the emphasis is on, stability, 
internal organization and adherence 
to rules. Herein, norms and values are 
associated with efficiency, co¬ 
ordination and uniformity. Motivating 
factors are needs for security, order 
and rules and regulations. Scales 
which reflect this model are: 
formalization - a concern with formal 


providing teaching support, monitoring (often written) rules and procedures; 
school activily and buffering staff efficiency; and tradition - a concern 
against distractions from their work. with maintaining existing policies, 

practices and procedures. 


Table 1. Structural and thematic parallels between Leithwood 
et al. (2006) and Day et al. 


leadership who were familiar not only with the principal 
effectiveness literature but also with the CVF itself. 
Subsequent to this content validity assessment, the items 
were tested for structural validity by placing the individual 
items on cards, submitting the cards to a panel of 
teachers, and asking the panel to sort related items into 
eight stacks of eight cards. Without prior knowledge of 
either the CVF or its roles, the panel correctly grouped six 
out of eight items per role, for an average "hit" rate of 75%. 
For the remaining 25% that were incorrectly grouped, 
items that were identified with a CVF role within the same 
quadrant were merely edited for greater clarity. Flowever, 
more erratically-grouped items were discarded, 
alternative effectiveness behaviors were identified, and 
different items were written to these alternatives. 
Classroom Observation Measures 
Trained observers conducted classroom visits to collect 
frequency data regarding observed instructional 
practices. The visits were targeted or scheduled in 
advance with teachers randomly selected from those 
who participated in the program's technology training. 
Selected teachers were instructed to deliver a lesson that 
integrates the use of technology. The data collection 
instruments were the School Observation Measure® (SOM) 
and the Survey of Computer Use® (SOU). The SOM was 
used to collect data regarding overall classroom 
activities, while the SOU was used to collect data 
regarding student use of computers. These classroom 
observation instruments are described below. 

Student Observation Measure (SOM) 

The SOM was developed to determine the extent to which 
different common and alternative teaching practices are 
used throughout an entire school or during a targeted 
lesson (Ross, Smith, &Alberg, 1999). During this evaluation, 
it was used to record observations of classroom instruction 
during prearranged one-hour sessions in which randomly 
selected teachers demonstrated a prepared lesson for 
which they were asked to use technology The observers 
recorded classroom events and activities descriptively, 
not judgmentally. Notes forms were completed every 15 
minutes of the lesson to record the use or non-use of 24 
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target strategies and the degree to which a high level of 
academically focused class time and a high level of 
student attention/interest was observed. At the conclusion 
of the one-hour lesson, which typically lasted from 45 to 60 
minutes, the observer used a SOM Data Summary Form to 
summarize the frequency with which each of the 
strategies was observed, The frequency was recorded via 
a 5-point rubric that ranges from (0) Not Observed to (4) 
Extensively. In a reliability study (Lewis, Ross, & Alberg, 
1999), pairs of trained observers selected the identical 
overall response on the five-category rubric on 67% of the 
items and were within one category on 95% of the items. 
Further results establishing the reliability and validity of the 
SOM instrument are provided in the Lewis et al. (1999) 
report. 

Survey of Computer Use (SCU) 

A companion instrument to SOM is the Survey of 
Computer Use (SCU) (Lowther & Ross, 2001). The SCU was 
completed as part of the SOM observation sessions during 
which SCU data were also recorded in 15-minute intervals 
and then summarized on an overall data form. The SCU 
was designed to capture exclusively observable student 
access to, ability with, and use of computers rather than 
teacher use of technology. Therefore, in its first section, 
four primary types of data are recorded: (a) computer 
capacity and currency, (b) configuration, (c) student 
computer ability and (d) student activities while using 
computers. Computer capacity and currency is defined 
as the age and type of computers available for student 
use and whether or not Internet access is available. 
Configuration refers to the number of students working at 
each computer (e.g., alone, in pairs, in small groups). 
Student computer ability is assessed by recording the 
number of students who are computer literate (i.e., easily 
used software features/menus, saved or printed 
documents) and the number of students who easily use 
the keyboard to entertext or numerical information. 

The next section of the SCU records the types of student 
computer activities, and the subject areas of those 
activities. The computer activities are divided into four 
groups based on broad categories of software used: 
production tools, Internet/research tools, educational 


software, and testing software. Within each category, 
more specific types of software are identified. In the 
Production Tools category, the software types include: 
word processing, databases, spreadsheets, draw/ paint/ 
graphics, presentation, authoring, concept mapping, 
and planning. In the Internet/research tools category, the 
software include: Internet browser, CD reference 
materials, and communications (e.g., email, blogs, 
websites). In the Educational Software category, the 
software types include: drill/practice/tutorial, problem¬ 
solving and process tools. The Testing Software types 
include individualized/tracked and generic. With this type 
of recording system, several activities can be noted 
during the observation of one student working on a 
computer. The frequency with which the computer 
activities and software were observed in use was 
summarized and recorded using a five-point rubric that 
ranges from (0) Not Observed to (4) Extensively observed. 
The subject area of each computer activity was 
categorized as: language arts, mathematics, science, 
social studies, other, or none. 

The final section of the SCU is an "Overall Rubric" designed 
to assess the degree to which the activity reflects 
"meaningful use" of computers as a tool to enhance 
learning. The definition of meaningfulness is derived from 
the International Society for Technology in Education's 
National Educational Technology Standards for Students 
(NETS-S) (ISTE, 2007). The rubric has four levels: 1 - Low-level 
use of computers, 2 - Somewhat meaningful, 3 - Meaningful 
and 4 - Very meaningful. Reliability data for the SCU 
(Sterbinsky, Ross & Burke, 2004), show that observer ratings 
were within one category for 97% of the whole-school 
observations and for 91 % of the targeted observations. 
Data Collection 

The data collection procedures for the two primary data 
sources used for this study were: (i) Leadership 
Effectiveness Assessment Device (LEAD) survey and (ii) 
extant SOM and SCU data are described below. 

LEAD Survey: Information regarding online completion of 
the LEAD survey was distributed via email to the FTL Lead 
Teachers, who then distributed the information to FTL 


i-manager’s Journal of Educational Technology, Vol. 6 • No. 1 • April - June 2009 


33 






RESEARCH PAPERS 


teachers at his or her school. The information included a 
brief introduction and overview of the LEAD survey, 
instructions tor completing the online survey, the URL for 
the survey, and the school-specific ID and Password 
needed to access and submit the survey. The Lead 
Teachers were contacted beginning February 2008. 
Extant SOM and SCU Data: Data from SOM and SCU multi¬ 
class observations was used to derive implementation 
levels for each school. The multi-class observations were 
used to capture routine classroom practices that typically 
occur on a regular basis in FTL classrooms. Therefore, this 
type of observation involves an extended timeframe (3 
hours) in which multiple FTL classrooms in one school were 
randomly observed. For instance, one multi-class 
observation consisted of an observer spending 3 hours in 
an FTL school conducting 15-minute observations in up to 
10 randomly selected FTL classrooms. At the conclusion of 
the 3 hours, the observer records the frequency with which 
the various instructional practices were observed. 

The 2005-2006 FTL evaluation data was used to determine 
the implementation level for each of the 86 schools for 
which multi-class observations were conducted. The SOM 
and SCU data represent classroom practices that were 
observed in 599 FTL classrooms. The data was extracted 
from CREP's Enterprise Class Relational Database and 
transferred to SPSS for data analysis. 

Results Analyses 

The results of the leadership evaluation study are 
presented in association with each of the FTL program 
evaluation research questions in the following section. 

• What was the composition of the responding FTL 
sample by schools and respondents within schools as 
Classroom Teachers, Lead Teachers, or "Other"? 

Of the 124 LEAD survey respondents who completed the 
64 item survey, 66 of them identified themselves as FTL 
Classroom Teachers (53.2%), while the remaining 58 
(46.8%) identified themselves as either FTL Lead Teachers 
(50) or some Other Respondent (8). 

• How did the respondents rate the effectiveness of FTL 
implementation at their schools, both in the 
aggregate and by the role played by the 


respondent ? 

Of the 124 LEAD survey respondents who both responded 
to the implementation effectiveness item and 
completed all 64 LEAD items, nearly two-thirds (63.7%) 
found the program to have been "largely" (40.3%) to 
"very" (23.4%) effectively implemented at their schools. 
To determine whether Classroom Teachers or Lead 
Teachers/Others differed in how they rated FTL 
implementation effectiveness at their schools, an analysis 
indicated that there was no statistically significant 
difference observed among the two respondent 
subgroups. 

• To what extent did the effectiveness ratings of 
administrators seen as most responsible for leading 
the FTL implementation Principal, Assistant Principal, 
or "Other Administrator"differ by a] the type of the 
respondent providing the rating, b) the kind of 
administrator being rated, and c) combinations of 
these variables? 

In response to the question concerning which 
administrator was perceived as being the most 
responsible for leading the FTL implementation at their 
location, 69 indicated the "Principal" (55.6%), six (4.8%) 
indicated the "Assistant Principal," and 49 (39.5%) 
indicated some "Other Administrator." Among Classroom 
Teachers, there was no significant difference observed in 
the FTL implementation effectiveness ratings attributed to 
Principals/Assistant Principals and Other Administrators. 
Among the 58 Lead Teachers/Others who completed the 
survey, no significant difference was found by the two 
types of administrators rated. 

When FTL effectiveness ratings were analyzed irrespective 
of the type of respondent providing the ratings, no 
significant differences were observed for either the 75 
Principals/Assistant Principals or the 49 Other 
Administrators. When the type of respondent (as 
Classroom Teacher or Lead Teacher/Others) was crossed 
with the kind of implementation leader rated (as either 
Principal/Assistant Principal or Other Administrator), 
analyses suggested no statistically significant difference 
either for the subgroups nested within the 124 LEAD survey 
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completers. 

• To what extent did respondent ratings as to the 
perceived size of the role played by the leader differ 
a) the type of the respondent providing the rating, b) 
the kind of administrator being rated, and c) 
combinations of these variables? 

With respect to the size of the role played by the 
administrator leading the implementation, sixty-five, or 
52.4%, of the LEAD survey completers indicated that the 
role of the administrator leading the implementation had 
been "large" to "very large". Only 28 of 124 LEAD survey 
completers (22.6%) offered that the leader had played 
only a "small" role to "almost no role". With respect to the 
larger group of 160 respondents, the responses of the 66 
Classroom Teachers and 58 Lead Teachers/Others in the 
group of LEAD survey completers were homogeneous 
with respect to the size of the leader's role. Notably, the 
perceived size of the role played in the implementation by 
the type of administrator as either Principal/Assistant 
Principal or Other Administrator differed markedly, as 
Other Administrators were perceived to have played a 
somewhat larger role. 

Among the 124 LEAD survey respondents, 69 indicated 
the Principal (55.6%), six (4.8%) indicated the Assistant 
Principal, and 49 (39.5%) indicated that an Other 
Administrator played the most significant perceived role in 
the FTL implementation. Of these 49 Other Administrators, 
approximately 80% were variously categorized as 
"technical advisors", "directors", "consultants", 
"coordinators" 1 , "administrators", "curriculum directors", 
"instructional specialists", "librarians", "media specialists", 
"superintendents", and "past administrators". The 
remaining 20% of the Other Administrators were 
categorized as Lead Teachers, Classroom Teachers, or 
either "no administrator" or some administrator whose 
exact position was not described. Results indicated that 
Lead Teachers/Others believed Other Administrators to 
have played a larger role in the FTL implementation than 
did either the Classroom Teachers with respect to 
Principals/Assistant Principals; or Lead Teachers/Others in 
regards to Principals/Assistant Principals. As rated by Lead 
Teachers/Others, the role size of Principals/Assistant 


Principals was significantly lower than the administrative 
role size of Other Administrators. 

• To what extent were respondent ratings as to the 
implementation effectiveness of FTL associated with 
the perceived size of the role played by the leader 
according to the role of the respondent, type of 
administrator being rated, and combinations of 
these variables? 

For the 124 respondents who completed the LEAD survey, 
all of the observed correlations between perceived 
implementation effectiveness and the perceived size of 
leader's role were homogeneous. When examined by the 
type of rater, the correlations between ratings of FTL 
implementation effectiveness and the perceived size of 
the role of the leader were not significantly different from 
one another when the responses of the 66 Classroom 
Teachers and those of the 58 Lead Teachers/Others were 
examined. Similarly, the correlations appeared to be 
largely homogeneous by the type of administrator rated: 
for the 75 respondents who rated Principals/Assistant 
Principals as playing the most significant leadership role in 
the FTL implementation, and the 49 respondents who 
rated Other Administrators as more important. 

• To what extent did respondent ratings on the eight 
LEAD scales differ across all FTL respondents and FTL 
respondent subgroups? 

The data analyses for this question revealed statistically 
significant multivariate differences among the means on 
the eight LEAD scales across all 124 respondents and in 
the interaction of the pattern of differences in the eight 
scale means across the two different types of 
administrators thought most responsible for leading the 
FTL implementation. In comparing the scale means 
across all 124 respondents, the greatest differences 
systematically involved the Monitor and Mentor roles. 
Means for these two roles tended to be significantly lower 
than means observed for the Producer, Coordinator, 
Facilitator, Innovator, and Broker roles. In comparing the 
patterns of differences between the two categories of 
administrators being rated, a series of independent 
analyses indicated that FTL Principals/Assistant Principals 
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were perceived as having exercised three LEAD roles 
more than Other Administrators: specifically, the Director 
role, the Monitor role, and the Broker role. 

• To what extent do respondent ratings of FTL 
implementation effectiveness correlate with the 
eight LEAD scales and the instrument as a whole? 

For all 124 FTL survey completers, scores on the overall 
LEAD survey were moderately but significantly correlated 
with implementation effectiveness ratings. Individual LEAD 
scales were also statistically related to respondents' 
perceptions of FTL implementation effectiveness, with the 
strongest association observed between effectiveness 
ratings and the non-directive, collegial Facilitator role, 
and the weakest association observed between 
effectiveness and its near-opposite, the Director role. With 
respect to the individual items constituting the Facilitator 
scale, the strongest correlation was seen between 
implementation effectiveness and the item "makes it 
easy for teachers to collaborate with one another". 
Contrastingly, with respect to the individual items 
constituting the Director scale, the weakest correlation 
was observed between implementation effectiveness 
and the item "specifies goals and objectives that guide 
teachers' planning and everyday practices". 

With respect to breakouts of the data by type of rater and 
the type of administrator rated, the highest correlations 
were observed between FTL implementation 
effectiveness and the Facilitator role for Classroom 
Teachers,: the Producer role for Lead Teachers/Others: the 
Broker role for those identifying Principals/Assistant 
Principals as playing the most important FTL 
implementation role; and the Facilitator role for Other 
Administrators. Conversely the lowest correlations that 
consistently observed in responses by all LEAD survey 
respondents were between FTL implementation 
effectiveness and the Director role, for both the 
Principals/Assistant Principals and for Other Administrator 
FTL implementation leadership roles. 

• What differences exist among FTL subgroups and their 
scores on the overall LEAD? 

Analyses of the LEAD survey response data suggested no 


statistically significant differences by the two groups of 
raters (Classroom Teachers and Lead Teachers/Others). 
Plowever, differences did emerge when the identified 
leadership roles of the raters was introduced as a factor. 
Therein, a single significant difference was found: 
specifically between: 40 Classroom Teachers rating 
Principals/Assistant Principals, 26 Classroom Teachers 
rating Other Administrators, 35 Lead Teachers/Others 
rating Principals/Assistant Principals, and 23 Lead 
Teachers/Others rating Other Administrators. The analyses 
employed suggested that Classroom Teachers' ratings of 
the overall leadership of Principals/Assistant Principals 
were significantly higher than Classroom Teachers' ratings 
of Other Administrators. 

• What relationships are existing between school-level 
scores on the Multi-Class SOM and SCU and FTL 
Respondent ratings of the implementation 
effectiveness of the initiative, the size of the role 
played by the leader, and leadership ratings on the 
LEAD? 

Data previously obtained at 87 FTL schools on the Multi- 
Class School Observation Measure (SOM) and the Multi- 
Class Survey of Computer Use (SCU) were merged with 
data derived from the present study that had been 
aggregated from the level of the individual FTL 
respondent. When the different data files were merged, 
40 different FTL school matches were found wifh respect 
to the Multi-Class SOM and the Multi-Class SCU. 
in investigating the matrix of correlations, the SOM item 
concerning "Computer for instructional delivery" was 
seen to correlate positively with five of the LEAD roles; most 
strongly with the Producer, Facilitator, and Innovator roles, 
as well as with the overall LEAD. Further, three LEAD scales 
evidenced robust correlations with the SOM item 
concerning "High level of student attention/interest/ 
engagement," specifically the Producer, Monitor, and 
Innovator roles. Both the Producer and the Innovator role 
also correlated significantly with the four-item SOM 
composite. 

With respect to the perceived size of the administrator's 
role, the strongest correlation observed was for the 
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Computer Usage SOM composite. Although FTL 
implementation effectiveness did not seem to correlate 
significantly with any of the individual SOM items, 
significant correlations were observed between it and the 
Computer Usage SOM Composite, as well as with the 
Composite of the Four SOM items [which four?]. 

At the 28 FTL schools for which SOU data were available on 
students' "basic" computer skills, the respondents' sense of 
what FTL implementation effectiveness meant correlated 
both systematically and robustly with students' "computer 
literacy" and "keyboarding" skills, and the composite 
(average) of these two items. With respect to the LEAD 
scales, systematic and robust correlations were observed 
particularly between the SOU outcomes and the Mentor 
and Innovator roles. While the Mentor role was only 
modestly associated with students' "computer literacy" 
skills, it correlated strongly with students' "keyboarding" 
skills and the composite of the two SOU "computer basics" 
items. Even more strongly associated with these SOU 
outcomes was the Innovator role; that role correlating with 
both SOU items individually as well as with the composite 
of the two items. The total LEAD score was observed to 
correlate especially with students' "keyboarding skills" and 
modestly with the composite of the SOU "basic skills" 
items. 

At the 40 FTL schools with SOU scores on the Production, 
Internet, Educational Software, and Testing scales, means 
were computed for each school by averaging the scores 
obtained across each of the constituent items. Two of the 
SOU scales appeared to be associated with respondent 
perceptions of FTL implementation effectiveness: use of 
the Internet and use of Educational Software. Associated 
with four of the eight LEAD scales specifically, the Director, 
the Mentor, the Innovator, and the Broker roles as well as 
the overall LEAD score, was the SOU scale concerning the 
use of Testing software. 

Findings 

The responses from the LEAD survey concerning how 
effectively the Michigan Freedom To Learn program was 
implemented indicated that nearly two-thirds of the 
respondents (63.7%) found the FTL program to have been 


"largely" (40.3%) to "very" (23.4%) effectively 
implemented at their schools. In identifying which 
administrator played a key role in the FTL implementation, 
over 55% indicated the school Principal, approximately 
5% indicated the Assistant Principal, and nearly 40% 
indicated Other Administrator. For the 124 respondents 
who completed the LEAD survey, there were consistent 
correlations between perceived implementation 
effectiveness, as measured by previously collected SCU 
and SOM data, and the perceived size of leader's role. 

For the entire group of survey completers, scores on the 
LEAD survey were moderately but significantly correlated 
with implementation effectiveness ratings and the 
following implications can be found in the study's results: 

• Overall, the FTL implementation was viewed as 
successful by a majority of responding constituents. 

• Slightly more than half of the respondents viewed their 
principals as playing the key role as leaders in the FTL 
implementation. 

• A significant percentage of the respondents viewed 
"others" (neither principals nor assistant principals) as 
playing the key role as leaders in the FTL 
implementation. 

• While FTL implementation effectiveness did not 
correlate significantly with any of the individual School 
Observation Measure (SOM) items, as previously 
measured in the FTL implementation, some 
significant correlations were observed between the 
identified LEAD roles and the Computer Usage SOM 
Composite. 

• Positive correlations were found between five of the 
identified LEAD roles, and were most evident with the 
Producer, Facilitator, and Innovator roles, 
respectively. 

• The strongest correlation observed was for the 
Computer Usage SOM composite and the perceived 
size of the leader's role. 

• Also noteworthy was the correlation found between 
the perceived size of the leader's role and "Fligh levels 
of student engagement", specifically in the 
Producer, Monitor, and Innovator roles. 
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• No significant relationships were observed between 
the Director and Coordinator roles with any of the 
SOM items or item composites. 

• Student computer use (SCU) as previously measured 
in the FTL implementation was positively correlated 
with the identified leadership roles of Mentor and 
Innovator. These are leadership roles defined by 
personal interaction and risk-taking attributes, 
respectively. 

• The strongest associations, as observed in LEAD survey 
results, were between effectiveness ratings and the 
non-directive, collegial Facilitator role; the weakest 
association observed was between implementation 
effectiveness and the Facilitator role's near-opposite, 
the Director role. The Director role is characterized 
mostly by emphasizing productivity and efficiency 
goals, and not creative solution-seeking. 

Conclusions 

Overall, the Michigan Freedom To Learn implementation 
was viewed as successful by a majority of responding 
constituents. Slightly more than half of the respondents 
viewed their principals as playing the key role as leaders in 
the FTL implementation, while a significant percentage of 
the respondents viewed "others" (neither principals nor 
assistant principals) as playing the key role as leaders in 
the FTL implementation. 

While FTL implementation effectiveness did not correlate 
significantly with any of the individual School Observation 
Measure [SOM] items, as previously measured in the FTL 
implementation, some significant correlations were 
observed between the identified LEAD roles and the 
Computer Usage SOM Composite, including positive 
correlations between five of the identified LEAD roles, with 
the Producer, Facilitator, and Innovator roles most 
evident, respectively. The strongest correlation observed 
was for the Computer Usage SOM composite and the 
perceived size of the leader's role, with a noteworthy 
correlation found between the perceived size of the 
leader's role and "High levels of student engagement" in 
the Producer, Monitor, and Innovator roles. Interestingly, 
no significant relationships were observed between the 


Director and Coordinator roles with any of the SOM items 
or item composites. 

Student Computer Use (SCU) as previously measured in 
the FTL implementation was positively correlated with the 
identified leadership roles of Mentor and Innovator. These 
are leadership roles defined by personal interaction and 
risk-taking attributes, respectively. 

The strongest associations, as observed in LEAD survey 
results, were between effectiveness ratings and the non¬ 
directive, collegial Facilitator role; the weakest 
association observed was between implementation 
effectiveness and the Facilitator role's near-opposite, the 
Director role. The Director role is characterized mostly by 
stressing productivity and efficiency goals, and not 
creative solution-seeking. 
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